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ABSTRACT 

Mapping the recent expansion history of the universe offers the best hope for uncover- 
ing the characteristics of the dark energy beheved to be responsible for the acceleration 
of the expansion. In determining cosmological and dark-energy parameters to the per- 
cent level, systematic uncertainties impose a floor on the accuracy more severe than 
the statistical measurement precision. We delineate the categorization, simulation, 
and understanding required to bound systematics for the specific case of the Type 
la supernova method. Using simulated data of forthcoming ground-based surveys and 
the proposed space-based SNAP mission we present Monte Carlo results for the resid- 
ual uncertainties on the cosmological parameter determination. The tight systematics 
control with optical and near-infrared observations and the extended redshift reach 
allow a space survey to bound the systematics below 0.02 magnitudes at z = 1.7. 
For a typical SNAP-like supernova survey, this keeps total errors within 15% of the 
statistical values and provides estimation of f7,„ to 0.03, wq to 0.07, and w' to 0.3; 
these can be further improved by incorporating complementary data. 
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1 INTRODUCTION 

With the great increase in observational capabilities in the 
past and next few years, we can look forward to cosmologi- 
cal data of unprecedented volume and quality. These will be 
brought to bear on the outstanding questions of our "prepos- 
terous universe" ICarroll 200 It -what new forms of matter 
and energy constitute 95% of the universe? what is the un- 
derlying nature of the mysterious dark energy causing the 
observed acceleration of the expansion of the universe yet 
without an explanation within the standard model of par- 
ticle physics? But more photons of any given observational 
method will not teach us the properties of the cosmologi- 
cal model before we understand the sources and intervening 
medium. Systematic uncertainties, rather than statistical er- 
rors, will bound our progress at the level where we fail to 
correct for astrophysical interference to our inference. 

This applies to each one of the promising cosmological 
probes. Use of the cosmic microwave background radiation 



has been dramatically successful in fitting certain cosmo- 
logical properties jSpergel et al. 2003| l, but others are tied 
up in degeneracies, insensitivities (e.g. to the dark energy 
equation of state behavior), and astrophysical foregrounds. 
Structure growth and evolution measures such as cluster 
counts by the Sunyaev-Zel'dovich effect or X-ray surveys 
and galaxy halo-density and velocity distributions through 
redshift surveys need to translate and disentangle observed 
quantities from theoretical ones, through problematic rela- 
tions such as the mass-temperature law and the nonlinear 
matter power spectrum. Asphericities, dumpiness, bias, and 
foregrounds all play roles. Similar difficulties also apply to 
weak and strong gravitational tensing, Sunyaev-Zel'dovich 
measures of the angular diameter distance, peculiar ve- 
locity measurements, Alcock-Paczyhski redshift distortions, 
etc. Certainly the Type la supernova method that discov- 
ered the acceleration of the universe (IPerlmuter et al. 19991 
IRiess et al. 19981 is not exempt. 
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Type la supernova measurements have an advantage in 
a long track record of observations pushing the systematics 
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to lower levels by understanding the astrophysical effects, 
making supplementary measurements, and correcting for the 
intervening quantities, reducing them to smaller residual 
uncertainties (IPerlmxitter fc Schmidt 2003^ . The quest for 
accurate cosmological parameter estimation at the percent 
level requires a well designed experiment dedicated to ob- 
taining a systematics-bounded dataset. As we seek to pur- 
sue the supernova distance-redshift measurements to higher 
redshifts we gain from the increased discrimination between 
model parameters and from degeneracy breaking, but also 
require more stringent understanding and correction of sys- 
tematics. 

The level of accuracy required goes beyond treatment 
by simple analytic and Fisher matrix methods. While a rig- 
orous treatment of the complexity of astrophysical observa- 
tions -from detector pixel response to light-curve fitting to 
non- Gaussian and correlated errors- requires a well crafted 
end-to-end Monte Carlo simulation of the survey, this is per- 
haps overly detailed and model dependent to draw general 
conclusions. 

In this paper we apply a more illustrative Monte Carlo 
method to broadly investigate the effects on cosmological pa- 
rameter estimation -both errors and biases- due to system- 
atic uncertainties and biases in the supernova magnitudes 
used in the Hubble diagram, or distance-redshift relation. 
Section 2 reviews the Hubble diagram. Section 3 consid- 
ers the effect of an irreducible uncertainty in the form of 
both constant and redshift dependent magnitude systemat- 
ics, while Section 4 examines the effect of a magnitude off- 
set bias. The next three sections trace specific systematics 
through the supernova observations to the Hubble diagram 
and the cosmology fitting: Section 5 discusses calibration er- 
ror, Section 6 selection effects (Malmquist bias), and Section 
7 the magnitude de/amplification from gravitational lensing. 
Section 8 addresses methods for countering "evolution", or 
population drift, through comprehensive use of spectral and 
ffux time-series data. 

For the Type la supernova method, this paper presents 
the basic analysis of the role of systematic errors and correc- 
tive measures in obtaining accurate as well as precise deter- 
minations of the cosmological parameters. Any cosmological 
probe or similar supernova survey must carry out such stud- 
ies in order to quote parameter fitting capabilities with rigor. 
In the end, however, we will have a broad network of results, 
complementary and cross checking and thus synergistically 
powerful, that test the cosmological model and lead us to- 
ward understanding the fundamental physics responsible for 
our accelerating universe. 



2 TRACING COSMOLOGY WITH 
SUPERNOVAE 

Type la supernovae have long been recognized as a pow- 
erful probe of cosmological dynamics, particularly in the 
measurement of its rate of expansion. In the SN la Hubble 
diagram, a plot of supernova peak magnitude versus red- 
shift, the supernova brightness serves as a proxy for the 
supernova distance. The redshift z — a^^ — 1 measures 
the scale factor a, the size of the universe when the su- 
pernova light was emitted relative to its current size. At 
low redshift, the data provide confirmation of a linear re- 
lationship between redshift and distance, the Hubble law. 
The dispersion of the data around the Hubble law mea- 
sures how well supernova brightnesses serve as a proxy to 
distance. Studies of Type la Hubble diagrams have pro- 
vided convincing evidence that SNe la can serve as stan- 
dardizable candles, being able to determine luminosity dis- 
tances to 5-10% UPhillips et al. 1999|rmpp fc Branch 1999| 
|Riess, Press fc Kirshner 1996| l. Models for SNe la must and 
do provide a simple theoretical explanation for this observa- 
tional homogeneity (IHoflich et al. 200311 . 

When considering distant supernovae, one should rec- 
ognize that cosmological distances translate into a lookback 
time t to when the supernova explosion occurred. Thus the 
distance-redshift measurement is also a mapping of the cos- 
mic expansion history a{t). At further lookback times (larger 
distances), secular deviations from the linear Hubble law, 
which represents a constant expansion rate, measure the 
acceleration or deceleration of the expansion of the uni- 
verse. Fitting a set of cosmological parameters to the data in 
the Hubble diagram allows precise discrimination of differ- 
ent cosmological models, together with error estimation and 
confidence levels. This paper uses Monte Carlo and a fiexi- 
ble x'^-based cosmology fitter to simulate data from various 
distributions of supernovae, add statistical and systematic 
errors, and derive joint probability contours for the cosmo- 
logical parameters. 

The critical ingredients are the background cosmology 
model ( t|2.1ll . the supernova survey characteristics ( H'Z.'It . 
and the observational and astrophysical errors (i5]-3Zl- De- 
tails of the fitting procedure are given in >I2.3I 



2.1 Cosmology 

The luminosity distance to an object at redshift z is given 
in terms of its comoving distance r{z) by d{z) = (l + z) r{z). 
Astronomers use magnitudes, a logarithmic measure of flux, 
which neglecting astrophysical effects like dust absorption. 
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can be written as 

m{z) = 51ogi(,d(2;) 

+ [M + 25-51ogio(-ffo/(100km/s/Mpc))] , (1) 

where the distance d(z) is made dimensionless by removing 
the Hubble scale H^^ , M is the absolute magnitude of a 
supernova, and the constant in brackets is often notated M. 
The influence of the cosmology resides in d{z), or equiva- 
lently r{z). 

The comoving distance follows directly from the metric 

by 



-1/2 



sinh 



1/2 



dz'/ \H{z')/H^ 



(2) 



where = 1 — S7tot, f2tot is the total dimensionless energy 
density of the universe, sinh is analytically continued to sin 
for imaginary arguments, and H{z) is the Hubble parameter. 
Since cosmic microwave background data strongly suggests 
our universe is flat, Q,k = 0, we employ in the rest of this 
paper the appropriate limit, 

dz'l [H{z')/Ho] (3) 



dz' [n^{i + z'f 

+ (l-^„)e^^'#^<^+-<^"»]-^/^ (4) 

Here is the dimensionless matter density and w{z) is the 
equation of state, or pressure to energy density ratio, of the 
other component - negative-pressure dark energy. 

Two common parameterizations for the equation of 
state are w = too + wiz and w = wq + ifa(l — a), 
where a is the scale factor of the universe. The exponential 
in © resolves respectively to (1 + 2')3(i+"'o-™i)g3™i2' 



/\3{l + tlio+JHa)„-3™az'/(l + z') 



In either case we have a 



(1 + z 

three-parameter phase space describing the cosmology: Q,m, 
Wo, w' (where the time variation w' is taken to be either wi 
or Wa/2; for purely historical reasons, we use wi in this pa- 
per). This covers the important quantities of the energy den- 
sity, the dark-energy equation of state (EOS), and a measure 
of the physically revealing EOS time variation. In addition 
there is the nuisance parameter of the zero offset Ai. 

For a flducial model we adopt in this paper (except in 
Fig.|KJ a model with flm = 0.3 in matter and 1 — Qm in a cos- 
mological constant, w — —1 (that is, wq = —1 and w' = 0). 
Section H2.3l contains a discussion of the effect of variation of 
the model. The parameters are allowed to range freely about 
the fiducial values. However, we do generally impose on the 
matter density a Gaussian prior a{^l,n) = 0.03, reflecting an- 
ticipated information from other cosmological probes. While 
we believe that this is a reasonable assumption (there are 



recent studies | |Allen, Schmidt fc 1^'abian, 2002^ that claim 
that a precision around a{^lrn) = 0.035 has already been 
achieved) , we have checked that relaxing this assumption to 
a{Q,rn) ~ 0.05 would roughly increase all uncertainties on 
w' given below by less than 50%, while leaving the other 
parameters unchanged (see also (IWeller fc Albrecht 200 it ). 
Alternatively, a slightly more powerful constraint could have 
been obtained by including as a prior the projected measure- 
ment of the distance to the surface of last scattering by the 
Planck mission HFrieman et al. 2003t . 

2.2 Supernova Survey Characterization 

The observations can be characterized in terms of the dis- 
tribution in redshift of the supernova distance data and the 
dispersion about perfectly constant intrinsic peak flux (ab- 
solute magnitude) remaining after standardization for as- 
trophysical and observational effects. For determining cos- 
mological parameters, only the relative flux ratio between 
supernovae at different redshifts, not the absolute values, is 
important, thus the constant offset A4 composed of the ab- 
solute magnitude and the Hubble constant is just a nuisance 
parameter that needs to be integrated over. 

One promising survey is the proposed Super- 
nova/Acceleration Probe (SNAP) JSNAP 200311 . This in- 
volves a 2 meter telescope in space discovering and following 
some 2000 SNe la between z = 0.3—1.7 with an optical/near 
infrared imager and spectrograph. 

The magnitude dispersion of a given supernova is as- 
sumed to be constant and independent of redshift, for a well 
designed survey. We take it to be am ~ 0.15 for all sur- 
veys. This roughly corresponds to an intrinsic magnitude 
dispersion of 0.1 mag (or a 5% uncertainty in distance) and 
an equivalent statistical uncertainty in the determination of 
the corrected peak magnitude. The aggregated statistical er- 
ror can be reduced by increasing the survey size to boost the 
number of supernovae. Note that at redshifts z < 0.8 SNAP 
essentially follows all supernovae in the volume, so for these 
redshifts the sky area or survey lifetime would need to in- 
crease to gain statistics. 

Since the sensitivity of the data to the cosmological 
parameters depends on redshift (for example at low red- 
shift the distance reduces to ci = 2: for all cosmological 
models), the redshift distribution of the supernovae is im- 
portant. The major effect is from the survey depth, Zmax', 
optimization studies show the parameter estimations to 
be fairly insensitive to the exact distribution so long as 
the full redshift range is covered lIHuterer fc Turner 20011 
IFrieman et al. 20038 . Thus other observational and instru- 



4 Alex G. Kim, Eric V. hinder, Ramon Miguel, Nick Mostek 



Table 1. The redshift distribution N{z) of the 2000 SNe employed from a fiducial SNAP survey. The redshifts z given 
in the table correspond to the upper edges of each bin. 



z 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 1.1 1.2 1.3 1.4 1.5 1.6 1.7 
N{z) 35 64 95 124 150 171 183 179 170 155 142 130 119 107 94 80 



mental considerations can be taken into account for the dis- 
tribution without harm to the science results. 

For the space-based mission we adopt a fiducial distri- 
bution shown in Tabled which we will call the SNAP distri- 
bution in the following. When considering shallower surveys 
we cut and rescale the SNAP distribution; truncating the 
SNAP distribution at the new Zmax and then multiplying 
N{z) by the factor needed to keep the total number un- 
changed from the original, e.g. 2000 supernovae. This en- 
sures that we can compare surveys based on their redshift 
reach, with their statistics on an equal footing. As we dis- 
cuss in >I3.1I the parameter estimation precision is not driven 
by statistics, i.e. numbers of supernovae, so we consider the 
total number fixed at 2000, well within the capabilities of 
SNAP. We have also checked that adopting instead a form 
N{z) of some proposed ground-based survey afi'ects the re- 
sults by less than a few percent. 

Additionally, in all cases we include a very low red- 
shift ("local Hubble fiow") group of supernovae, 300 be- 
tween z = 0.03 — 0.08, such as will soon be available from 
the Nearby Supernova Factory | |Aldering et al. 2002^ . These 
prove important for marginalizing (averaging) over the extra 
parameter A4 to reduce the parameter phase space. 

2.3 Cosmological Parameter Fitting 

Given the elements of the previous two subsections, we can 
generate Monte Carlo realizations of supernova magnitude 
data vs. redshift, i.e. Hubble diagrams. These are then fit 
with the set of cosmological parameters using an unbinned 
minimization method. Two independent codes, one us- 
ing the Minuit minimization package from the CERN li- 
brary IMinuit 200211 and the other a CERN adaptation of a 
NAG routine (IN AG 200211 . have been checked against each 
other. Each generates the best fit to the data within the 
four dimensional parameter space {Qrn,wo,w' ,A4} and the 
contours of 68% (or whatever level) confidence. The two- 
dimensional plots shown are marginalized over the other 
two parameters. In general the errors are non-Gaussian and 
asymmetric. Where numbers are quoted as la errors, they 
refer to the 68% confidence level parabolic error on that pa- 
rameter, marginalizing over the rest of the likelihood space. 



Note that the error contours depend not only on the 
data errors but also on the background, fiducial cosmology. 
This is discussed and illustrated in 21 So in fact there is 
no unique parameter estimation precision associated with a 
given survey, even if the data properties, systematics, and 
priors are all specified. The numbers we quote are for Sim ~ 
0.3, a flat universe, and the dark energy being a cosmological 
constant, unless stated otherwise. 

Errors on dark-energy properties go down as its energy 
density, and hence effect on the expansion, increases. For 
example, if Qm = 0.25 the SNAP estimates of wo and w' 
improve by 13% and 8% respectively with respect to the 
fiducial case Qrn ~ 0.3. Making w{z) more positive than the 
fiducial value —1 over the redshift range of the data, either 
by increasing wo or taking a positive w' , raises the dark en- 
ergy density at those redshifts. So this also increases the sen- 
sitivity of parameter estimation, and hence precision. Thus, 
if the effective equation-of-state parameter is less negative 
than —1, the cosmological model we have adopted gives a 
conservative assessment of the supernova method as a cos- 
mological probe. 

3 UNCORRELATED SYSTEMATIC 
UNCERTAINTIES 

In addition to the statistical errors already discussed, sys- 
tematic uncertainties need to be taken into account. These 
arise from imperfect sources (e.g. population evolution), im- 
perfect detectors (e.g. calibration errors), and intervening 
astrophysics (e.g. dust, gravitational lensing). Detailed dis- 
cussion of methods developed for bounding these through 
precise and multiwavelength observations and like-to-like 
subsample comparison is beyond the scope of this paper (see 
§5EHH1 for an introductory treatment). Rigorously, this re- 
quires a comprehensive Monte Carlo simulation with a mul- 
titude of model dependent parameters characterizing the in- 
struments, astrophysics, survey strategy, etc. Here we con- 
centrate on principles derived from a more general analysis 
of illustrative systematic error behaviors. 

To draw conclusions about the impact on cosmological 
parameter determination within a given survey, we investi- 
gate two general forms of systematics. The first is a random 
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dispersion that is irreducible below some magnitude error 
over a finite redshift bin. We adopt a bin width Az = 0.1 
as a rough estimate of the correlation of cosmic conditions 
and instrumentation. The second systematic is a (possibly 
redshift dependent) magnitude offset that acts coherently 
on all supernovae (discussed in 

The size of these systematic uncertainties will de- 
pend on details of the survey depth and strategy and 
the instrument suite. The SNAP mission is specifically de- 
signed in these details to bound the sum of all known 
and proposed systematics below 0.02 mag. Besides this 
fiducial we also consider the effect of larger errors over 
the same redshift range and the case of a shallower sur- 
vey such as could be achieved from the ground. Frie- 
man et al. lIFrieman et al. 2003t and Linder & Huterer 
JLinder fc Huterer 200311 discussed the generic need for ob- 
servations to reach beyond z « 1.5 to detect the time varia- 
tion w' , improve precision on uiq, and, most relevant to this 
paper, immunize against systematics. 

3.1 Random Irreducible Systematic — Flat 

An error that is inherent to the measurement process of a su- 
pernova would not be statistically reduced with greater num- 
bers of measurements. Hence we refer to it as irreducible. 
Examples of this class could be calibration errors, and er- 
rors in galaxy subtraction coming from the lack of perfect 
knowledge of the point spread function. 

To simulate such an error, we introduce an irreducible 
magnitude error, dm, on the measurement in each super- 
nova redshift bin. In essence, this models an error in such 
a binned approach for each filter type on the camera whose 
peak response is roughly spaced in redshift by /S.z — 0.1. 
The error is added in quadrature to the canonical 0.15 mag 
intrinsic magnitude dispersion per SN: 

= \l^ + id^y . (5) 

where Ntin is the number of supernovae in a 0.1 redshift bin 
(see, e.g., Table0. 

Figure shows the 68% joint probability contours in 
Wo and w' for SNAP's distribution of 2000 (extending up 
to z — 1.7) plus 300 nearby supernovae under irreducible 
magnitude errors dm — 0.02, 0.04. To show the dominance 
of the systematic contribution over the statistical error we 
also double the number of supernovae in each bin (except 
the first bin representing the SNfactory sample). A fiducial 
input cosmology of fim ~ 0.3, wo = —1.0, w' = is used 
along with a prior on Q,n of 0.03. The intrinsic statistical 
error contours are also plotted for reference. 
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Figure 1. Dark energy parameter contours for three irreducible 
systematic cases. The central reference contour has only the in- 
trinsic statistical error. Note the substantial increase in parameter 
error as the systematic is increased from dm = 0.02 to 0.04. The 
two closely paired contours show that doubling the number of 
SNe will only increase parameter accuracy by si 5%. 

Let us note three important points about the system- 
atic uncertainties evident from the figure: 1) they are the 
dominant source of error, 2) they impact parameter deter- 
mination in nontrivial ways, and 3) allowing systematics to 
exceed 0.02 mag can strongly affect parameter estimation. 

Overall one clearly sees that observing thousands more 
supernovae will not help in cosmological parameter estima- 
tion. Only by tighter bounds on the systematics can one im- 
prove precision. The systematics impose an error floor and 
become the dominant contribution over the statistical error 
for 

iVbin > (0.15/dm)^ (6) 

For dm = 0.02 mag this works out to about 55 supernovae 
per bin. It is worth noting some reasons, however, why one 
might want to exceed this number somewhat. These include: 

(i) Subsamples, e.g. collections of supernovae with simi- 
lar spectral properties, allow carrying out a like-to-like com- 
parison to identify and bound systematic uncertainties. Ex- 
amination of supernovae within a bin, i.e. all at the same 
redshift, probes systematics while analyzing like subsamples 
at different redshifts probes cosmology more cleanly. 

(ii) Lowering statistical errors well below the systematics 
floor reduces the total, quadratic sum error. For example 
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twice as many supernovae as the break even number given 
by eq. JHJ lowers the total error to within 22% of the floor. 

(iii) Additional data can mitigate the effects of mis- 
estimation of the coherence scale, i.e. effective bin size, of the 
systematic. That is, since a systematic of 0.02 mag over a 
bin size of Az = 0.05 is roughly the same as dm = 0.0i4 mag 
over Az = O.i, more data ensures that statistical errors will 
not if the systematic error is smaller than 0.02 mag. 

(iv) The complete supernova sample will include events 
that suffer significant host-galaxy dust absorption and grav- 
itational demagnification. Beyond our systematic concerns, 
the light-curve and spectral measurements of these objects 
will carry reduced statistical weight due to their fainter ap- 
pearance. An increased number of supernovae per redshift 
bin will make up for the expected range of data quality. 

Overall, a contingency of roughly a factor of two more su- 
pernovae should prove satisfactory. 

For the second point, Fig.Qshows how a constant irre- 
ducible systematic of 0.02 magnitudes increases the param- 
eter estimation errors. Note that the systematic does not 
simply scale up the contour but rather stretches it along 
the parameters' correlation or degeneracy direction (very 
roughly defined by u''-|-4u;o=const lllfuterer fc Turner 20011 
IWeller fc Albrecht 200T1lLinder fc Huterer 200311 '). Relative 
to the pure statistical error case, a 0.02 mag systematic in- 
creases the uncertainty in wo by a factor of 2 and wi by 26%. 
The effect of systematics on parameter estimation can also 
be a strong function of depth of the survey and underlying 
cosmological model, as discussed in the following sections. 

Increasing the magnitude error beyond 0.02 mag, to 
0.04, strongly degrades the precision with which the dark- 
energy parameters can be recovered. The constraint of wo 
suffers an additional 78% and w' incurs an extra 44% in- 
crease. Both of them become so imprecise that the limits are 
not useful. Therefore, bounding the systematics to 0.02 mag- 
nitudes is an important science goal for an experiment that 
hopes to detect the time variation of the dark-energy equa- 
tion of state. Instruments and observation strategies must 
be specifically designed with this in mind. Garnering a suf- 
ficiently rich, well calibrated, and homogeneous set of data 
allows control for astrophysical and measurement effects so 
as to leave behind only a less than 0.02 mag residual. 

Figure |21 illustrates the same systematics in the wo — 
Qm plane. Again, the statistical errors are only a minor 
contribution to the total. Because the parameter estimation 
of JIm is dominated by the imposed prior a{QM) = 0.03, the 
systematic acts in the wq direction. The uncertainty in wq 
increases over the purely statistical error by a factor of 2 and 
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Figure 2. Contours for the mass density f2jvf versus the present 
dark energy equation of state too for three irreducible systematics. 
As the systematic increases, the large increase in error for the 
equation of state is clearly apparent. The parameter error 
stays constant since a prior constraint of ^(Ojvf ) = 0.03 dominates 
the estimation. 

4 when dm = 0.02 and 0.04, respectively. Note that no prior 
assumption about w' was imposed, so the equation of state 
variable is wo not merely a constant w. Given that we are 
seeking to test the nature of dark energy, not assume it, and 
that there is no compelling theoretical model that predicts 
a constant value (other than possibly —1), we do not believe 
that results involving a constant w serve any useful purpose 
for precision cosmology. 

3.2 Random Irreducible Systematic — Linear in 
Redshift 

Observations extending to the redshift depth necessary to 
probe dark energy, z > 1.5, are challenging and one might 
well expect some possible errors to be exacerbated with 
increasing redshift. The restframe optical emission of su- 
pernovae shifts to the observer frame as 1 + z, with key 
spectral features ai z — 1.7 approaching 1.7 microns, so 
infrared capabilities are crucial to these high redshift ob- 
servations. SNAP is specifically designed to include high- 
precision photometry out to 1.7 microns, but residual uncer- 
tainties enter. For example, models for Hubble Space Tele- 
scope (HST) spectrophotometric standards can disagree up 
to 1% at 1.7 microns IIBohlin 200211 due to the lack of preci- 
sion exo-atmospheric, spectrophotometric measurements in 
the near infrared (NIR). 



Systematic Uncertainties on Cosmological Parameters 7 



s 



1,11 


1 1 1 1 1 1 , 1 1 1 , 1 




tT(n„)-o.o3 


\ (' 


68% cl 


■■, \ 
\ \ 
■■. \ 




■-. \ 
■. \ 


^ w 








^^^^^^^^^ 












s ■. 


~ z =1.7, 

max ' 


dm = 0.02(z/1.7) 


--Z =0.7, 

max ' 


dm = 0.03(z/0.5) 


z -0.7, 

max ' 

. 1 . . 


dm = 0.05(z/0.5) 

< . 1 . . . 1 . . <" 1 . 



■1.4 



-1.2 



-1 



0.8 



0.6 



-0.6 



-0.8 



S -1 



-1.3 



-1.4 





1 1 1 1 1 1 1 1 1 , 1 1 1 1 

2000+300 SN - 


- 




- 


DO/o Cl 




. ' ^ ^ \ ' ■■ 
.■ ^ \ ■, 


■V 


'' ^ ■■. - 
'' ■, 

\ ■■. 


) 

) 






1 

. \ /■■ — 




■"^ ■■' 


- z =1.7, 

max ' 


dm=b.,02(z/1.7) / 


z =0.7, 

max ' 


dm = 0.03(z/0.5.) ■' 


z -0.7, 

max ' 


dm = 0.05(z70.'5) 

. < < . 1 . . . . 1 . < . . 



0.2 



0.25 



0.3 



0.35 



0.4 



Figure 3. Dark-energy parameter contours with a linear system- 
atic that increases with redshift. The SNAP contour includes a 
systematic of dm = 0.02(2/1.7) benefiting from the experiment's 
high precision photometry and survey depth. Also plotted are 
two systematics simulating ground-based experiments that have 
larger photometric errors into the infrared and an effective red- 
shift depth limited by the atmosphere. 



Since wavelength maps to redshift, larger errors in the 
infrared translate to increasing uncertainties at higher red- 
shifts. To simulate the effect of such uncertainties on param- 
eter determination, a linearly increasing systematic, dm — 
Sm (z/zmax), is adopted. As before, this is added in quadra- 
ture to the intrinsic 0.15 mag statistical error for supernova 
peak magnitudes in a binned approach: 



(7) 



Parameterization in terms of Zmax and 5m allows us to per- 
form trade studies on other surveys with different redshift 
depths and infrared error limits. The SNAP design bounds 
the uncertainty for all relative photometric measurements to 
0.02 mag, so the systematic ramps up as dm = 0.02(0/1.7). 

Figure |3 shows parameter estimation confidence con- 
tours for some different survey depths and amplitudes of the 
linear systematic. These include SNAP, modeled as a space- 
based experiment with Zmax = 1-7 and Sm = 0.02 mag, and 
a ground-based experiment with an atmosphere-limited ef- 
fective redshift of Zmax ~ 0.7 and either an optimistic Sm = 
0.04 mag (corresponding to the line with dm = 0.03* (2/0. 5) 
in Fig. or a less challenging 0.07 mag (corresponding to 



Figure 4. Error contours in the f2]v/ — uiq plane for systematic 
errors linearly increasing with redshift. The SNAP measurement 
of Wo shows the advantage of a deeper space-based survey with 
better photometric accuracy. There is a negligible change in the 
Qm measurement since the parameter is bounded by prior infor- 
mation. 



dm = 0.05 * (2/0.5) in Fig. ^ . The surveys were otherwise 
identical, with the same number of supernovae (the SNAP 
distribution of TableQwas cut at Zmax and rescaled to total 
2000 supernovae) and prior on the matter density. 

The figure dramatically demonstrates that a deeper sur- 
vey in redshift with the infrared capabilities to control sys- 
tematics (especially dust extinction), opened up by the move 
to space, provides a superior lever arm in determining the 
cosmological parameters. Ground-based surveys, however, 
are limited for obtaining a homogeneous, complete data set 
to Zmax < 0.7 (see jnji increased statistics, such as provided 
here with 2000 supernovae, will not help. Figure|3]shows that 
even in the optimistic ground-based case, the parameter un- 
certainty increases by a factor of 3 in wo and a factor of 4 
in wi. The other case, Sm = 0.05, perhaps more realistically 
simulates the increase in uncertainties due to atmospheric 
absorption and night sky emission as one ventures into the 
infrared from the ground. Here the parameter estimation 
degrades by 24% in wo and 36% in wi, just relative to the 
optimistic ground-based survey. 

The equivalent blowing up of the confidence contours 
in the wo — plane is shown in Fig. |1| Clearly, redshift 
depth and dedicated instrument design to bound systematic 



^ These two values bracket the precision claimed for the proposed 
Essence supernova survey ssence "20031 . 
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uncertainties are crucial to achieving precision cosmological 
parameter determination. 

While the two models for systematics discussed in the 
last two subsections are not exhaustive, they do give a broad 
feel for different, physically motivated behaviors. These anal- 
yses indicate that the survey requirement of bounding sys- 
tematics below 0.02 mag is both necessary and sufficient for 
the science goals of constraining the dark energy equation 
of state and its possible variation. 



4 SYSTEMATIC BIASES 

The other category of systematic effects considered is a co- 
herent shift in magnitude for all supernovae at a given red- 
shift. This could arise from broad astrophysical or detector 
issues such as residual uncertainties in intergalactic absorp- 
tion, or selection effects such as Malmquist bias (see JUl- 

The effect of an offset in magnitude is a bias in the best 
fit parameters. That is, the data no longer guide the observer 
to the true underlying cosmology but rather to a false model. 
Obviously this is of great concern since we seek not only pre- 
cise but accurate answers. Interestingly, the bias can actually 
somewhat reduce the dispersion around the best (incorrect) 
fit, since as mentioned in t|2.3l the errors depend on the lo- 
cation within the parameter space. Thus one could be put 
into the situation of finding a wrong answer very precisely. 

Bounding offsets below 0.02 mag, however, ensures that 
bias of the fit parameter from the true value is negligible, 
i.e. less than half the random, dispersive error. Furthermore, 
one is fortunate in that it is not the entire amplitude of the 
offset that alters the cosmological parameters of interest, 
but rather only its variation from the mean over the survey 
depth. Thus a constant offset has no effect on the cosmo- 
logical and dark energy parameter estimation, and a linear 
increase to 0.02 mag at the maximum redshift is equivalent 
to a —0.01 mag shift at low redshift and a +0.01 mag shift 
at high redshifts. This point is sufficiently important that 
we present a formal proof in the Appendix. 

4.1 Monte Carlo Analysis of Systematic 
Magnitude Offsets 

Upon adding a constant 0.02 mag offset to all supernova 
magnitudes we verified by Monte Carlo that the best fit 
value of M was biased from an input of to 0.02 while the 
fits for the cosmological parameters returned the true values 
and had errors indistinguishable from the case without such 
a systematic bias. 

To investigate bias in the parameters and its ampli- 
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Figure 5. Dark-energy parameter contours after a magnitude 
bias is introduced. The solid lines include systematic errors but 
no offset, while the dashed curves have an offset but no system- 
atic uncertainties. The upper plot corresponds to the fiducial 
universe with wq = — 1 and uii = 0, while the lower plot cor- 
responds to the SUGRA-inspired scenario IBrax fc'^ artin 1999] 
IWeller fc Albrecht 200T1 with wo = -0.8 and wi = 0.3. Note the 
large dependence of the precision attainable on the underlying 
cosmology. 



tude relative to its random error, we introduced a mag- 
nitude offset that linearly increases with redshift. Specif- 
ically, we adopt dm = ±0.03(z/1.7). Figure |3 shows the 
results for two different underlying cosmologies. The up- 
per plot has an input model where the dark energy is a 
cosmological constant: wo ~ —1, wi — 0, while the lower 
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plot illustrates a model with time- varying equation of state 
for the dark energy; wq — —0.8, lui = 0.3, correspond- 
ing to a supergravity inspired model (IBrax fc Martin 19991 
IWellerfc Alhrecht2nmt. 

In each case the dotted contours give the parameter 
estimation assuming only statistical errors on the SNAP 
supernovae. One can clearly see the dependence of errors 
and correlations on the location in parameter space, as dis- 
cussed in t|2.3l The effect of a random irreducible error, such 
as from il3.2l is to stretch the confidence contours, generally 
unequally for the two parameters. Such an expansion, shown 
by the solid contours, gives the increase in dispersion due to 
the extra random uncertainty. 

However the effect of a coherent offset in magnitude, 
shown by the dashed contours, is very difi'erent. Here the 
contours are shifted in the wq — w\ plane in the presence of 
the bias, with the positive magnitude bias shifting the con- 
tours negatively in wi . Little bias is seen in the wo direction 
because the supernova magnitude offset is highly correlated 
with the time variation mi and not so much with the sin- 
gle, present value of the equation of state. This can be seen 
as follows: Increasing the magnitude is dimming the super- 
novae; this means they have a greater luminosity distance 
at a given redshift than allowed by the fiducial cosmology, 
corresponding to more expansion of the universe and hence 
a more potent acceleration, provided by a more negative 
equation of state. Because the magnitude offset is here in- 
creasing with redshift, one requires a time varying change 
in the equation of state, i.e. a more pronounced wi. (Recall 
a magnitude offset that is constant with redshift can be ab- 
sorbed wholly into the A4 parameter, while a different wo 
does not lead to a monotonic magnitude offset.) 

Also note that the biased confidence contours alter their 
shape and size slightly with respect to the unbiased, purely 
statistical error case. As discussed in >I2.3I this is the result 
of the different location, and hence sensitivity, in parameter 
space. In fact, the linear bias may even decrease the statisti- 
cal uncertainty. But roughly one can consider the effect of an 
offset magnitude systematic as shifting the statistical error 
contour to a biased best-fit value in the parameter space. 

To guard against biased parameter determination one 
needs to bound systematic effects that give rise to redshift 
dependent magnitude offsets. In general, improved account- 
ing for systematics by extending observations to high red- 
shift and into the infrared, requiring a space based instru- 
ment, constrains such errors. Taking this into account, we 
consider linearly rising offsets reaching 0.02 and 0.04 mag 
at Zmaz = 1.7, and 0.04 and 0.07 at Zmax ~ 0.7. The first 
one represents the SNAP systematics goal and 0.04 mag il- 



lustrates the elects of failing to achieve it. The second two, 
ground, offsets are larger in magnitude to simulate the in- 
herent difficulties in precision measurements through the at- 
mosphere of higher redshift supernovae whose emission is 
shifted into the near infrared. The corresponding supernova 
distribution is taken to extend out to Zmax = 0.7 where 
ground based surveys run into degraded light curves and 
Malmquist bias due to the atmospheric limitations. The size 
of the ground offsets are chosen to give residual uncertain- 
ties slightly better and worse than proposed for the Essence 
supernova survey IIEssence 2003t . 

As discussed before, the strongest effect is on the time 
variation of the equation of state, wi. The four cases respec- 
tively give biases of 0.37cr, 0.67a, 0.75a, 1.2a, where a is the 
corresponding statistical error for each case. How much bias 
is acceptable is somewhat subjective. If we require that the 
bias should not exceed 0.5a, then we see that even the am- 
bitious ground-based survey fails this for wi , and we cannot 
tolerate 0.04 mag offset for the deep, space-based survey. 
But a random irreducible systematic of these same ampli- 
tudes is far more damaging to parameter estimation than 
the coherent offsets discussed in this section. As mentioned 
in ? tl3. 113.21 the depth and wavelength coverage accessible 
to a space-based survey substantially immunizes it against 
such uncertainties. For example the estimation of wi de- 
grades by a factor of four when Zmax = 0.7 but only by 6% 
when Zmax = 1.7. 

4.2 Low-Redshift Supernova Calibration Offset 

A discontinuity in calibration between the proper SNAP 
sample and the low redshift Nearby Supernova Factory 
(SNF) measurements would present a different type of off- 
set error. The SNF data play a critical role in reducing the 
uncertainty on A4, and hence w' through the correlation of 
these parameters. Since we conjoin datasets from two sepa- 
rate projects it behooves us to investigate a magnitude offset 
caused by differences in the observing methods and equip- 
ment. 

To simulate such an effect we introduce a constant off- 
set to all SNF supernovae relative to the SNAP dataset. 
Because the offset is at a single, low redshift, the major 
effect is on wq. For an offset in the range 0.01-0.05 mag, 
the bias in fitting the too parameter amounts to a fraction 
1.2(cim/0.02) of the statistical error. So to keep the bias 
less than the statistical error, the offset should be restricted 
below 0.02 mag. Experimentally, spectrophotometric obser- 
vations of the same standard stars by both SNF and SNAP 
should limit the offset below 0.01 mag. We have found that 
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the biases in the other parameters, fim and w' , are indeed 
much smaller as a fraction of their statistical errors. 



5 CALIBRATION UNCERTAINTY 

The calibration procedure for a survey is an important po- 
tential source of systematic uncertainties. Since calibration 
enters so early in the data pipeline, these uncertainties can 
propagate through several stages. For instance, consider a 
calibration uncertainty on the blackbody temperatures, and 
hence fluxes, of two or more calibration sources and their 
correlations. That error would affect the measured fluxes 
of supernovae directly, as well as indirectly through the K- 
correction and the extinction corrections. The subsequent 
magnitude errors then affect the cosmological parameter de- 
termination. 

Due to the complexity of the problem, we go beyond 
our previous analytic models and develop a complete Monte 
Carlo simulation. The central ingredient is a calibration 
model (like the two blackbody model just mentioned) with 
a certain number of free parameters (in this case, the tem- 
peratures of the blackbodies) , their uncertainties, and the 
correlations among them. Realizations of calibration param- 
eters are fed to a simulation of a SNAP-like mission. This 
includes statistical observational errors, multiband measure- 
ments, and the appropriate treatment of reddening and K- 
corrections. The result of each pass of the simulation is a set 
of SNe with their measured magnitudes and errors; many re- 
alizations then provide the individual supernova magnitude 
errors and correlations. The cosmology fltter uses this error 
covariance matrix to generate uncertainties and covariance 
contours in the cosmological parameters. 



extinction coefficient, Rv, are drawn from a Gaussian dis- 
tribution centered at 3.1 and with standard deviation 0.3. 

Once a set of parameters defining the calibra- 
tion is chosen, it is used to compute zero points 
for each filter, which in turn enter the cross-filter K- 
corrections l |Kim, Goobar fc Perlmutter 1996t . The stan- 
dard SNAP filter set has been simulated, although simpli- 
fied to square filters. These involve nine filters logarithmi- 
cally spaced and broadened in 1 -I- z lAkerlot et al. 200311 . 
For each SN there is significant data in a minimum of three 
and a maximum of nine filters, depending on redshift. The 
fiux in each filter is further smeared with an uncorrelated 
2% error to account for statistical errors. 

All optical and near-IR (in the SN frame) photometric 
data for a given SN are used to fit for two parameters: its 
magnitude and its extinction parameter Ay- By contrast, 
Rv is assumed in the fit to be constant at 3.1. It has been 
found that this assumption introduces only a small bias in 
w' in the final result without affecting the result for wq. 
As an example, sampling Rv from a Gaussian distribution 
centered at 3.5 and with standard deviation 0.3 in the gen- 
eration stage, while keeping Rv fixed at 3.1 in the fitting 
stage, results in biases of —0.15 in w' and —0.002 in wo- 

After many realizations of the calibration parameters, 
enough statistics are collected to determine the central value 
and variance of the magnitude of each SN, as well as the cor- 
relations among them. These are input to the cosmology fit, 
along with an error of 0.15 magnitude added in quadrature 
to each supernova. This accounts for the statistical errors 
and the natural dispersion of the SN intrinsic magnitude. 
As previously, a flat Sim ~ 0.3 plus cosmological constant 
universe is fiducial, along with a Gaussian prior of 0.03 on 



5.1 The Monte Carlo Simulation 

In the Monte Carlo simulation, the supernova redshift distri- 
bution and cosmological model are as given in ^ As before, 
only the component of the calibration error which varies 
with redshift or, equivalently, with wavelength, matters for 
cosmological parameter estimation. 

Differential dimming of the supernova magnitudes in 
the various observed wavelengths by dust is simulated us- 
ing the standard parameterization of Cardelli, Clayton and 
Mathis HCardelfi, Clayton fc Mathis IQSOl l. Values for the 
extinction value, Av, come from a distribution obtained 
from a Monte Carlo simulation llCommins 2002t that places 
SNe in random positions of a galaxy with random orienta- 
tion with respect to the line of sight. Values for the global 



5.2 Calibration Models 

Two calibration models have been studied, broadly describ- 
ing the classes of calibration procedures. In the first one 
jLampton 2002| |, a single calibration source is taken as ref- 
erence for all wavelengths, in the optical and infrared (IR) 
regions. The source is parameterized as a blackbody with a 
temperature T, known with a precision AT. This model can 
be thought of as representing a hot white dwarf whose spec- 
trum is well understood in both the optical and IR regimes. 
Typical values for T would be around 20000 K, with uncer- 
tainties in the few percent range. 

In a second, possibly more realistic, model 
IDeustua 200211 . two calibrators are employed: one with 
temperature Ti ± ATi for the optical region, A < l^m. 
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and another with T2 ± for the infrared region, 

f/im < A < l.l^ra. The errors in the two temperatures are 
taken to be correlated with correlation coefficient p. The 
optical calibration could be from a hot white dwarf, while 
the near infrared calibration could correspond to a NIST 
standard or a solar equivalent. In both cases, T2 would 
be a few thousand Kelvin. The errors would again be a 
few percent. Although the two calibration sources are not 
expected to be correlated in themselves, correlations can 
enter either from common instrumental systems and data 
reduction or from the process of connecting the optical and 
near-IR calibrations. 



5.3 Results 

For the one-temperature model, Fig.|S|shows the 68% confi- 
dence level contours in the wq-w' plane for the case without 
calibration errors, with a 1% error in T, and with a 10% 
error in T. Even allowing for a 10% uncertainty in T results 
in a very small systematic error in the cosmological parame- 
ters. This unintuitive result can be explained by noting that 
in the Rayleigh- Jeans region a miscalibrated temperature 
corresponds mostly to a change in overall flux scale, which 
is absorbed in M, and then the tilt, or color in astronomical 
terms, is treated by the extinction correction for flux differ- 
ences between wavelengths. For a model with a single free 
parameter, T, the correction is almost perfect. 

Figure |7| shows the equivalent contours for the two- 
temperature model. Now the effect of the calibration error 
can be clearly seen. For 3% uncertainties it leads to an in- 
crease in the errors of wq and w' of around 20%, relative to 
the purely statistical errors. 

The results are fairly insensitive to the correlation co- 
efflcient p until it is nearly one. Then the calibration re- 
duces to the one-temperature model. A 50% increase in the 
magnitude of the error in the optical region also does not 
strongly affect the parameter estimation. So long as the two- 
temperature model realistically approximates the entire cal- 
ibration procedure, a moderate precision at the few percent 
level should suffice for calibration to pose only a minor con- 
tribution to uncertainty in the cosmological parameter esti- 
mation. In particular, 3% errors in both temperatures and 
any degree of correlation between the optical and infrared 
calibration measurements limit the increase in the overall 
error to < 20% of the result without any calibration error. 

Also note that if an optical calibration source can be de- 
termined to 1% (as the solar effective temperature already 
is IDeustua 20021 '). then the error increase due to the cali- 
bration systematic uncertainty drops below 10%. And if im- 
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Figure 6. Joint probability contours for the determination of 
wo and w' without calibration error and with two values of the 
calibration error in the one-temperature model. The increase in 
uncertainty is quite small due to the use of multiple filters that 
correct for calibration variations between them in the same way 
as for extinction caused by dust. 
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Figure 7. Joint probability contours for the determination of wq 
and w' without calibration error and with several values of the 
calibration errors and correlation in the two-temperature model. 
Calibration precision of order 3% in temperature is sufficient at 
these temperatures to keep parameter uncertainties within rea- 
sonable bounds. 
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provements in observations and modeling allow a single body 
like a hot white dwarf to be used to calibrate the whole spec- 
trum, then the precision of the calibration can be relaxed to 
10%. 



6 MALMQUIST BIAS 

Magnitude-limited searches for supernovae produce data 
samples with a selection effect called Malmquist bias: in- 
trinsically brighter supernovae will be preferentially discov- 
ered. As supernovae at the fainter end of the luminosity 
function fall below the detection threshold, the mean intrin- 
sic peak magnitude of discovered supernovae is biased lower 
(i.e. more luminous) than the mean for the whole popula- 
tion. The bias increases at higher redshifts as the apparent 
magnitudes of the supernova population grow fainter. This 
redshift-varying bias will thus enter the estimation of the 
cosmological parameters. 

Measurements of the intrinsic dispersion in SNe la range 
from 0.25 - 0.35 magnitudes. However, correcting super- 
nova magnitudes based on their light-curve time-evolution 

(stretch) can reduce the residuals to an rms of ~ 0.10 0.15 

magnitudes. Note that this also leads to a selection effect: 
supernovae with high stretch are more likely to be found - 
they remain visible in the sky longer and are intrinsically 
brighter. However, a well-designed survey ensures that the 
stretch determination of discovered supernovae is unbiased. 
Here we consider Malmquist bias in the stretch-corrected 
luminosity function. 

In principle, this error can be corrected for if the detec- 
tion efficiency and intrinsic luminosity function are known. 
But the luminosity function should vary with the star forma- 
tion history of the universe. Malmquist bias can thus stem 
from subtle systematic magnitude shifts arising from un- 
corrected population evolution of the progenitor systems. A 
precise bias correction requires well determined luminosity 
functions over the redshift span of interest. One way around 
this is by brute force: the detection threshold can be set 
much fainter than supernovae at the highest targeted red- 
shift. 

To illustrate the effect of Malmquist bias, we simulate 
light curves generated by a space survey with a SNAP-class 
telescope and a ground survey with a DMT-class (6.5m, e.g. 
LSST IILSST 2003t 'l telescope (augmenting the imager with 
an additional near infrared camera) sited at Mauna Kea. 
Ground observations are taken in the fiducial SNAP filter set 
with eight-hour observations. The observing cadence is four 
observer-frame days. Mauna Kea weather condition statis- 
tics are from (ISarazin "200211 and the seeing distribution com- 
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Figure 8. The efficiencies for detection of supernovae before max- 
imum light for a SNAP-class space survey and an effective 6.5 
meter telescope at Mauna Kea taking 8 hour exposures with a 
4-day cadence. Only supernovae with host-extinction Ay < 0.5 
are included in the sample. The 0.85 ground efficiency at low 
redshift is predominantly due to lost nights due to weather. The 
slightly jagged nature of the curves is due to the finite number of 
supernova realized in the simulation. 



piled at Subaru is used l |Aldering 2002| l. We include host- 
galaxy extinction with an absorption distribution based on 
| |Hatano, Branch fc Deaton 1998| l. 

We consider four simple detection triggers. The first 
two mimic triggers used in current ground searches and de- 
mand at least two points with signal-to-noise S/N > 5 (7) 
in a single passband. The second two triggers require signif- 
icant signal, S/N > 5 (7), for two points in two passbands. 
This is important for the use of color time-evolution to dis- 
tinguish SNe la from other transients. We require discovery 
before maximum light to allow spectral observations at peak 
brightness. The detection efficiencies for these triggers are 
shown in Fig. |5] The space mission discovers supernovae 
with almost perfect efficiency. The ground search suffers a 
fundamental level of inefficiency which is independent of in- 
trinsic supernova luminosities since it is due to lost nights 
from poor weather. Efficiency from the ground sufi'ers a fur- 
ther drop-off at redshifts z > 0.9 — 1.2, depending on the 
trigger. 

The Malmquist biases induced by these triggers in space 
and ground missions are shown in magnitudes in Fig. |5] De- 
pending on the exact form of the trigger, the Malmquist bias 
on the ground grows beginning at z = 0.9 — 1.3. The more 
rigorous triggers with higher signal-to-noise thresholds or re- 
quiring detection in two bands have shallower redshift reach. 
From space, the bias remains < 0.01 mag for all triggers over 
the full redshift range. 

We calculate the effect of this Malmquist bias on the 
ground searches described in H2.2I As a representative ex- 
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Figure 9. Malrnquist bias for the four triggers for the space and 
ground-based surveys. Depending on the exact form of the trigger, 
the ground detection thresholds drop beginning at 0.9 < 2 < 1.3. 
The space mission shows neghgible Malmquist bias over the red- 
shift range of interest. The small fluctuations are due to the finite 
number of supernovae used in calculating the detection efficiency. 



ample, we consider the results from a trigger consisting of 
two S/N > 7 points in a single filter. To illustrate the bias 
that occurs, we calculate the statistical errors and bias in 
the fit parameters assuming no irreducible systematic error 
for three ground surveys with Zmax ~ 0.7, 1.0, and 1.3. For 
the two shallower surveys, the level of Malmquist bias is very 
low (cf. Fig. |5J and produces a bias that is small compared 
to the statistical errors. For the deepest survey, there is a sig- 
nificant 0.04 magnitude bias at Zmax = 1.3 that propagates 
into a significant component of the error budget; the bias in 
the measured cosmological parameters is now comparable to 
the pure statistical errors. There is little point in obtaining 
better statistics when the systematic errors dominate. Un- 
less Malmquist bias can otherwise be eliminated or corrected 
for, deeper ground searches are thus fundamentally limited. 

Note that this analysis only addressed the issue of 
Malmquist bias; there are difficulties posed to ground-based 
surveys by incompletely sampled lightcurves, lack of extinc- 
tion measurements as the supernova flux redshifts into the 
infrared, atmospheric emission, etc. 



7 GRAVITATIONAL LENSING 

Another effect on the measured flux of a supernova in- 
volves magniflcation or (more frequently) demagnification 
by weak gravitational lensing from intervening mass dis- 
tributions^. Since this conserves flux, the mean effect on 

^ Strong gravitational lensing, causing multiple images, is rare, 
affecting roughly one out of every thousand objects. Strong lens- 



supernovae at any redshift is null. However, the finite 
number of supernovae per redshift bin does not sam- 
ple the entire magnification distribution, leading to a 
slight bias in the results from the Hubble diagram anal- 
ysis. But this small bias can be determined from the 
data themselves l |Amanullah, Mortsell fc Goobar 2003^ , in- 
dependently of any model of gravitational lensing, and hence 
corrected, leaving only an additional systematic uncertainty 
coming from the limited statistical precision of the correc- 
tion itself. 

For weak lensing caused by large-scale structure, 
the rms of the shift is only a few percent and the 
mean shift can be averaged below 1% with only a cou- 
ple dozen supernovae per redshift bin IIDalal et al. 20031 
IHolz fc Linder 2003t . Here we consider the remaining case 
of lensing by compact objects, which generally gives a 
broader distribution of magnifications, following the method 
of dAmanuUah, MortseU fc Goobar 2003| l. They show that 
the distribution of the biases in magnitude can be ade- 
quately parameterized by a functional form with three free 
parameters: 



/(m) = exp 

/(m) = exp 
+ b-\m 



(m - mp)^ 
2a2 

(m - mo)^ 
2^ 

-mJ ■ 10'"" 



m > rric 



m < rric 



(8) 



where m is the bias after lensing, and the distribution takes 
into account the intrinsic dispersion of supernova magni- 
tudes. The distribution represents a Gaussian with an extra 
tail toward demagnification. The constants a and rric are set 
to 2.5 and respectively. The three free parameters, mo, cr 
and b, will in general depend on the redshift and the as- 
sumed fraction of intervening mass in compact objects, /p. 
We take fp = 0.2, which should give an upper bound on any 
plausible effect. 

For a given redshift z one can determine IIMortsell 20021 
the set (mo,(T, &) that parameterizes the m distribution ^. 
We then generate a Monte Carlo sample of N{z) supernovae 
with the distorted m distribution. This distribution can be 
measured in real data by shifting the magnitudes of all su- 
pernovae in the bin to the value they would have had if their 
redshift had been that of the center of the bin. For this, one 
has to assume a certain cosmology, but the result is fairly 



ing of supernovae can be quite interesting and useful for cosmolog- 
ical parameter determination jOguri, Suto fc Turner 2003} but it 
will not significantly affect the Hubble diagram. 

Note that the distribution depends on z, with a generally in- 
creasing with z: hence its possible influence on cosmological pa- 
rameter determination. 
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insensitive to this for reasonable bin widths, and by iterating 
the procedure after the cosmology fit all such dependency 
can be suppressed. 

Once the m distribution (in real data or through Monte 
Carlo) is obtained, a fit is made in order to measure the pa- 
rameters of the distribution. Call the result (mg, a' ,b'). Each 
parameter will have been measured with a certain error. The 
central value of the distribution corresponds to the net bias 
in magnitude that has to be corrected. Monte Carlo is used 
in order to compute the uncertainty in this central value 
as a function of the uncertainties in (mo,a',&'). This pro- 
cedure has been implemented for z — 0.5, 1.0, 1.5 and N{z) 
from the fiducial distribution in Table Q The uncertainties 
after the corrections have been found to be 0.017, 0.018 and 
0.021 mag for the three redshifts, therefore in line with the 
assumptions made in previous sections of a systematic er- 
ror around 2%. A more realistic compact object fraction, 
fp < 0.1, would give a significantly smaller effect. 

8 EVOLUTION 

In the previous sections we have addressed systematic uncer- 
tainties arising from the detectors, the observation strategy, 
and the light propagation. A potentially serious systematic 
error lies in the supernovae themselves. While supernovae 
have no direct infiuence from the cosmic time, i.e. they don't 
"know" what redshift they are at IIBranch et al. 200111 , more 
subtle "evolutionary" effects can enter in the form of popu- 
lation drift. 

For example, suppose the metallicity of a supernova had 
an infiuence on its absolute luminosity and supernovae at 
higher redshifts systematically had a lower metallicity than 
nearby supernovae. In this case, if the survey did not rec- 
ognize and correct for this trend then the resulting Hubble 
diagram would be biased and the parameters resulting from 
the cosmology fit inaccurate. 

Two approaches to this problem can be considered. 
Both require the survey to acquire and use the wealth of 
observational information that each supernova provides in 
the form of its time series of fiux and its energy spectrum. 
Then the key assumption is that the state of the supernova is 
adequately described by these detailed measurements, that 
supernovae with the same lightcurve and spectrum indeed 
have the same absolute magnitude, that there are no "hid- 
den variables" . 

One approach is to carry out comprehensive modeling 
of Type la supernova explosions and radiation transport, ex- 
amining numerically the effects of varying progenitor char- 
acteristics. The underlying physics proves remarkably robust 



and the final state possesses an extraordinary degree of "stel- 
lar amnesia" to the initial conditions IIHoflich et al. 200311 . 
The remaining small variations in the light curves and spec- 
tra may even provide a tightening of the standard candle 
nature through a secondary correction parameter beyond 
stretch. 

However we adopt only the purely empirical path of ex- 
amining detailed observations of a wide range of supernovae. 
Any modeling is used solely to suggest features that might 
be of interest in the lightcurve and spectrum, and to serve 
as a subsidiary crosscheck. The Nearby Supernova Factory 
project l |Aldering et al. 2002^ will provide invaluable infor- 
mation on identifying secondary characteristics infiuencing 
the magnitude. Such a survey samples the breadth of galac- 
tic environments and physical conditions present at any red- 
shift, e.g. the range of metallicities. However as mentioned 
above, there could be a population drift -a change in the 
proportion of environments at the different redshifts. 

While analyses of supernovae with an average red- 
shift oi z ~ 0.5 JSuUivan et al. 20021 show no sign of 
a systematic trend (within the current precision) with 
galaxy type or location of the supernova within the galaxy, 
we need to guard against the possibility at higher red- 
shift. This leads to the program of "like-to-like" com- 
parisons llPerlmutter fc Schmidt 20031 IBranch et al. 200111 . 
One categorizes the supernovae based on the detailed ob- 
servations into subsamples with similar intrinsic character- 
istics, e.g. ratios of peak-to-late-time light-curve magnitude, 
ultraviolet properties, line ratios, etc. Then these narrow 
subclasses are compared across different redshifts, taking 
that like spectral and flux characteristics imply like intrinsic 
magnitudes -with sufficiently comprehensive measurements 
there is nowhere for a change to hide. This procedure, we em- 
phasize, is purely empirical and does not depend on any the- 
oretical model of the luminosity or of evolution. The mantra 
is that like supernovae at different redshifts give a clear view 
of cosmology, and different supernovae at like redshifts alert 
us to intrinsic systematics. 

To test this approach, we divided the total sample of 
SNe in up to ten subsamples, each with roughly the same 
number of SNe and similar distribution in z, allowing a dif- 
ferent intrinsic magnitude (i.e. M) for each subsample in 
the fit. The fit returned the same cosmological parameters 
as the fit with just one Ai, with a negligible increase in their 
statistical error. 

We then allow the subsamples to have different red- 
shift distributions, mocking up population drift. The 2000 
supernovae are divided into three subsamples of roughly the 
same size, one of them with the number of supernovae ris- 
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ing linearly with z, another one decreasing linearly and the 
third one flat, so that the total sample is uniform in red- 
shift. When a different value for the intrinsic magnitude is 
allowed for each subsample, one finds a small (less than 4%) 
increase in the uncertainty in uiq, relative to the case of a 
single sample of 2000 SNe uniformly distributed in z and 
with a single intrinsic magnitude for all the SNe. An even 
smaller increase (below 2%) is seen for w' , while essentially 
no change is observed for Q.m ■ Thus comprehensive data col- 
lection, including spectra, together with like vs. like analysis, 
appear to provide a robust solution for potential evolution- 
ary systematics. 



9 CONCLUSION 

Precision cosmological observations offer the hope to un- 
cover essential properties of our universe, including the na- 
ture of the dark energy that causes the present accelerating 
expansion and could determine its fate. But hand in hand 
with these advances must go understanding of the system- 
atic effects that could mislead us. We have presented in some 
generality as well as some detail several possible sources of 
systematic uncertainty for the Type la supernova method of 
mapping the cosmological distance-redshift relation. 

In every case we have shown that the residual uncertain- 
ties after using detailed measurements of the light curves and 
spectra, when bounded below 0.02 mag, do not significantly 
interfere with the goal of accurate estimation of the matter 
and dark energy densities, a{Q.A) ~ 0.03, the dark energy 
equation of state today, aiwo) = 0.07, and a measure of its 
time variation, a{w') — 0.3. 

This supports with analytic, numerical, and Monte 
Carlo simulations the conclusion that a well designed satel- 
lite survey of about 2000 Type la supernova, observed out 
to redshift z = 1.7, with complete lightcurve characteriza- 
tion and a spectrum for every supernova, can succeed in 
answering some of the most fundamental questions about 
our universe and physics. 

No other cosmological probes, promising though they 
might appear, have yet addressed the crucial question of 
systematics with the same degree of rigor. When this is es- 
tablished they may well offer valuable complementarity. For 
the supernova method, we note that the combined optical 
and near infrared observations and redshift reach to z = 1.7 
are critical elements in reducing the impact of systematic 
uncertainties. 
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APPENDIX A: FISHER MATRIX ANALYSIS 
OF SYSTEMATIC MAGNITUDE OFFSETS 

A constant level of magnitude offset can be absorbed wholly 
into the M parameter, leaving the cosmological parameters 
unaffected. We use the following proof as an illustration of 
the Fisher matrix method. 

The Fisher, or information, matrix method of error es- 
timation approximates the parameter likelihood surface by 
a paraboloid in the vicinity of its maximum. As long as 
the parameter errors are small, the Fisher method gives an 
excellent approximation to a full maximum likelihood anal- 
ysis. The Fisher matrix relates the observables, in this case 
the set of supernova magnitudes m{z), to the parameters 
6 = {rim, Wo, ^f', A4} through the sensitivities dm/dO: 

^ 1 /" , ,r/ X dm dm , , , , 

where Om ~ 0.15 and N(z) is the number of SNe in a redshift 
bin around z. The error, or covariance, matrix is the inverse 
of this, so for example a^{'wo) = (-F~^)MJomo- 

External or prior information is incorporated simply by 
adding the Fisher matrices. The simplest example is a Gaus- 
sian prior on a single parameter, say Qm, which corresponds 
to adding an information matrix empty save for a single en- 
try in the appropriate diagonal space; if prior information 
determines 0,m to ±0.03 then the matrix entry is 1/(0.03)'^. 
Rules of matrix algebra allow one to calculate how such a 
prior affects all the entries in the covariance matrix, i.e. the 
parameter estimation errors. 

A systematic offset in the observed magnitude similarly 
propagates into the results, in the form of a bias giving a 
best fit parameter value different from the input cosmolog- 
ical model (because this shifts locations on the likelihood 
surface it will also have a small effect on the statistical part 



of the errors). Denoting the offset as 5m{z), matrix algebra 
provides the bias relation 

Se, = F-\,-^ [ dzN{z)Sm{z)^, (A2) 

where summation over repeated indices is implied. This al- 
lows straightforward calculation of the induced bias, within 
the Fisher formalism. Note that this looks similar to the 
Fisher matrix expression l|Alfl but only contains a single 
sensitivity factor. 

However, the nuisance parameter M is purely additive 
and so has sensitivity dm/dM — 1. Thus Fmo has only one 
apparent derivative factor, like the bias expression. Indeed 
if we separate out the redshift independent part of the sys- 
tematic, Sm{z) = Smo + dm{z), then the term containing 
the constant offset reduces to 

S6i = F~^ijFjM Sma — Smo SiM- (A3) 

So the constant part of the offset systematic only causes a 
bias in the nuisance parameter M and does not affect the 
cosmological parameters. One could choose this to represent 
the mean offset, or to remove a constant from the offset such 
that the magnitude systematic is defined to be zero at zero 
redshift. 



